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ABSTRACT 

It  is  shown  that  the  satisfaction  of  a  standard  constraint  qualification 
of  mathematical  programming  — at  a  stationary  point  of  a  nonconvex  differ¬ 
entiable  nonlinear  program  provides  explicit  numerical  bounds  for  the  set  of 
all  Lagrange  multipliers  associated  with  the  stationary  point.  Solution  of  a 
single  linear  program  gives  a  sharper  bound  together  with  an  achievable  b°un<1 
on  the  1-norm  of  the  multipliers  associated  with  the  inequality  ^constraints . 
The  simplicity  of  obtaining  these  bounds  contrasts  sharply  with  the 
intractable  NP-complete  problem  of  computing  an  achievable, upper  bound  on  the 
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SIGNIFICANCE  AND  EXPLANATION 


The  purpose  of  this  work  is  to  show  that  a  fundamental  regularity 
condition  of  nonlinear  programming  contains  information  which  provides 
numerical  bounds  for  the  Lagrange  multipliers  of  local  solutions  of  nonlinear 
programs.  Lagrange  multipliers  play  a  fundamental  role  in  stability  and 
perturbation  analysis  of  nonlinear  programs. 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive 
summary  lies  with  MRC,  and  not  with  the  author  of  this  report. 


COMPUTABLE  NUMERICAL  BOUNDS  FOR  LAGRANGE  MULTIPLIERS  OF 
STATIONARY  POINTS  OF  NONCONVEX  DIFFERENTIABLE 
NONLINEAR  PROGRAMS 

O.  L.  Mangasarian 

Consider  the  constrained  optimization  problem 


(1) 

minimize  f(x) 

subject  to 

g(x)  g 

0, 

h(x)  “  0 

where 

f  1  Rn  ♦  R  f  g  •  Rn  -►  Rm 

and  h  :  Rn 

♦  Rk. 

It 

is  well  known  that  if  a 

standard  constraint  qualification  [2,  5] 

/  ^9t(x)z  <  -e,  Vh(x)z  =  0  for  some  z  e  Rn,  and 

(2)  \ 

'rows  of  Vh(x)  are  linearly  independent 
holds  at  a  local  solution  x  of  ( 1 )  at  which  f,  g  and  h  are  continuously 
differentiable,  I  *  {i  j  g^(x)  =  0} ,  Vg(x),  Vg^x)  and  Vh(x)  are  m  x  n, 
m  *  n  and  k  x  n  Jacobian  matrices  respectively,  e  is  a  vector  of  ones  and 
m  is  the  number  of  elements  in  I,  then  x  is  a  stationary  point  of  (1), 
that  is  it  satisfies  the  Karush-Kuhn-Tucker  conditions  [2] 

(3)  Vf(x)  +  uVg(x)  +  vVh(x)  *  0,  ug(x)  =  0,  g(x)  <  0,  u  >  0,  h(x)  =  0 

for  some  Lagrange  multipliers  (u,v)  B  Rm+k.  Let  W  denote  the  set  of  all 
Lagrange  multipliers  which  satisfy  (3)  for  a  fixed  x.  It  follows  from 
Gauvin's  theorem  [1]  that  if  x  is  a  local  solution  of  (1),  then  W  is 
nonempty  and  bounded  if  and  only  if  the  constraint  qualification  (2)  holds. 
What  we  would  like  to  point  out  in  this  note  is  that  any  z  in  the  set  Z 
points  satisfying  the  constraint  qualification  (2)  for  a  fixed  x  provides  an 
explicit  numerical  bound  for  all  (u,v)  in  W  as  follows: 

(4)  llul  <  Vf(x)z 

P  - 
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(5) 


"Vm'  '  "  V 


Ivl  <  max{IVf  (x  )BU  ,  ll(Vf(x)  +  ( Vf  (x  )z  )Vg  .  ( x )  )Bl  } 

p  ~  jei  p  dp 

where  B  is  the  n  *  k  matrix  defined  by 


(6) 


B  :=  Vh(x)T(Vh(x)Vh(x)T)-1 


and  Hull  denotes  the 
P 


m  _  D  Vp  _ 

*•*  1  1  for  p  e  [I,00)  and  Hu! 

/  OO 


p-norm  (  l  |u  .  |J 

j=1  3 

max  | u  | .  In  particular  we  have  the  following. 

1  <  3  <  I m  ■* 

1 .  Theorem.  Let  x  be  a  stationary  point  of  ( 1 ) .  The  corresponding  non¬ 
empty  set  of  all  Lagrange  multipliers  W  satisfying  the  Karush-Kuhn-Tucker 
conditions  (3)  is  bounded  if  and  only  if  the  constraint  qualification  (2) 
holds,  in  which  case  each  (u,v)  in  W  is  bounded  by  (4)  -  (5)  for 
p  e  [1 ,“] . 

Proof .  The  nonempty  set  W  is  bounded  if  and  only  if  there  exists  jio  (u.,v) 
satisfying 

(7)  UjVgjCx)  +  vVh(x)  =  0,  Uj  i  0,  (Uj,v)  /  0 

which  by  a  theorem  of  the  alternative  [3,  Theorem  l(i')  &  (iii)],  is 
equivalent  to  the  constraint  qualification  (2).  Hence  for  such  a  case  we  have 
for  (u,v)  e  W  and  p  e  that 

(8)  ,u,p  1  lull  y  <  max  _  {eu^  |  UjVg^x)  +  vVh(x)  +  Vf(x)  =  0,  Uj  >  0} 


m+k 


(8a) 


(uI,v)eR 


=  min^  {Vf(x)z  |  Vg^xjz  <  -e ,  Vh(x)z  =  0} 

zeR 


_  (By  linear  programming  duality) 

£  Vf(x)z  for  z  e  Z 

which  establishes  (4). 

Now,  for  any  (u,v)  e  W,  z  e  Z  and  p  e  [1,®]  we  have  that 

(9)  Bvl  <  {Ivl  |  -vVh(x)  =  Vf(x)  +  UjVgjfx),  Uj  >  0} 

P  v,u1  P  1 

<  max  (Ivl  |  v  =  - ( Vf ( x )  +  UjVg  (x))B,  Uj  >  0,  eu  1  Vf(x)z} 
v,u  P 
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•  , 


V*.‘ 


=  max{ll(Vf(x)  +  UjVgjJxJjBlI  |  Uj  >  0,  eUj  <  Vf(x)z} 
ui 

=  max  {i7f(x)Bll  ,  ll(7f(x)  +  (Vf(x)z)Vg  (x))Bl  } 

jei  P  DP 

where  the  last  equality  follows  from  the  fact  that  the  maximum  of  a  continuous 
convex  function  on  a  bounded  polyhedral  set  is  attained  at  a  vertex  [7, 
Corollary  32.3.4].  This  establishes  the  bound  (5). 

□ 

2.  Corollary.  The  bounds  (4)  -  (5)  of  Theorem  1  can  be  sharpened  by 
replacing  z  by  z  where  z  is  a  solution  of  the  solvable  linear  program 
(8a). 

We  note  that  the  bound  (4)  with  p  =  1  and  z  *  z,  where  z  is  a 
solution  of  (8a)  is  implicitly  given  in  the  elegant  proof  of  Gauvin  [1]  which 
characterizes  the  nonemptiness  and  boundedness  of  W  for  a  local  solution  x 
of  (1)  by  the  satisfaction  of  the  constraint  qualification  (2). 

It  is  interesting  to  note  that  the  first  part  of  the  constraint  qualifi¬ 
cation  (2)  (existence  of  z)  gives  an  achievable  bound  on  B u#  ^  #  whereas  the 
second  part  of  (2)  (linear  independence  of  the  rows  of  Vh(x))  gives  a  bound 
on  which  is  not  necessarily  achievable.  It  is  however  possible  (but 

impractical  for  large  k)  to  compute  max  _  IvB^  by  solving  2k  linear 

(u,v)ew 

programs:  max  max  _  ±  v^ .  However  to  obtain  max  __  HvB  one  is  faced 

1<i<k  (u,v)ew  (u,v)ew 

with  the  essentially  impossible  task  (even  for  a  moderate-sized  k  2  15)  of 

k  k 

solving  2  linear  programs:  max  max  _  cv,  where  C  is  the  set  of  2 

cec  (u,v)ew 

vertices  of  the  cube  (y  |  y  e  r\  -e  £  y  £  e).  in  fact  for  integer  p  2  1 

the  problem  max  _  BvB  has  been  shown  to  be  an  intractable  NP-complete 
<u,v)ew  P 

problem  [6] .  We  finally  note  that  the  methods  of  [4]  could  also  be  used  to 
obtain  the  bounds  of  this  work. 
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